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ABSTRACT 


Two statistical models are compared in the classification of crops 
recorded on color aerial photographs . A theory of error ellipses is 
applied to the pattern recognition problem. An elliptical boundary 
condition classification model (EBC), useful for recognition of candi- 
date patterns, evolves out of error ellipse theory. The EBC model is 
compared with the minimum distance to the mean (MDM) classification 
model in terms of pattern recognition ability. The pattern recognition 
results of both models are interpreted graphically using scatter diagrams 
to represent measurement space. Measurement space, for this report, is 
determined by optical density measurements collected from Kodak Ektachrome 
Infrared Aero Film 8443 (EIR) . The EBC model is shown to be a significant 
improvement over the MDM model. 


INTRODUCTION 


Earth ground patterns, represented by optical density feature 
measurement vectors were collected from Kodak Ektachrome Infrared Aero 
Film 8443 (EIR). Two statistical approximations of the distribution 
of these measurement vectors were developed. A feature measurement 
vector was constructed from EIR film optical density measurements to 
red, green, and blue light. Each optical density measurement was 
considered as an element (feature) of the feature measurement vector. 
Each element of the vector is a dimension of measurement space. A 
measurement vector with red, green, and blue light optical density 
measurements gives three dimensions to measurement space 1 . 

Specific earth ground patterns most often investigated in agricul- 
ture are crops, water bodies, and bare soil (Fig. 1). These different 
kinds of earth ground patterns can be considered as categories to be 
recognized by a classification model. The recognition ability for a 
classification model will be dependent on its approximation, usually 
statistical, of the feature measurement vector distribution for each 
category. 
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The set of all possible ground pattern feature measurement vectors 
is called measurement space 1 . The distribution of these measurement 
vectors in measurement space result in a scattering of points. Each 
vector is represented by a point in measurement space. The natural 
groupings or clusters of optical density measurement vectors (points) 
for EIR film in measurement space can be associated with specific 
ground pattern categories. Proper classification of a candidate pattern 
can be regarded as identifying a point in measurement space belonging 
to a particular cluster (category) of points. 

Part of the pattern recognition problem is to design classification 
models that partition measurement space into cells that correspond 
closely to the clusters associated with each ground pattern category. 

The other part of the pattern recognition problem is the selection of 
characteristic features used to construct measurement space which 
contains the ground pattern categories . 

The elliptical boundary condition (EBC ) and minimum distance to 
the mean (MDM ) statistical classification models are compared in this 
report. The EBC model partitions measurement space into elliptical 
cells while the MDM model partitions measurement space into irregular 
polygonal cells. Recognition results of ground pattern categories on 
EIR film were determined for each model. Scattering diagrams, repre- 
senting measurement space, were developed to explain recognition 
results obtained for each classification model. 


DATA MANAGEMENT PROCEDURES 


Ground patterns investigated in this report are shown in Figure 1, 
Water is shown in three modes of sun glinting defined as low reflecting 
(W), medium reflecting (M), and high reflecting (H). A cotton field 
(C) is shown with 90 to 100% vegetation cover. Bare soil is shown in 
dry (B) and disked (D) conditions. These ground patterns were randomly 
sampled for flight lines 1, 11, and 12 established by the United States 
Department of Agriculture, Weslaco, Texas to include as many agricultural 
conditions in the Rio Grande Valley as possible. 

A Hasselblad camera with a 50 mm lens was used to obtain aerial 
photographs on EIR (8443) film (70 mm) from these three flight lines. 

The camera was mounted in a plane so that photographs could be taken 
directly above (1800 to 3000 feet) ground pattern areas. Each flight 
line was photographed with 60 percent forward overlap. Six rolls of 
film were used between July 14 and July 27 of 1968 between the hours 
of 1052 and 1457 CDT. A Tiffen 15G filter was used on all cameras. 

A typical exposure was 1/250 at f/10. All film processing followed 
the recommended times, temperatures, and solution concentrations 
recommended by Eastman Kodak's E-3 process. 
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Positive transparencies of selected ground pattern areas were mounted 
in a Joyce-Lobl microdensitometer. Three scans were made of transects 
running through ground pattern areas appearing in selected frames. A 
scan was made using a red filter (Wratten 92), green filter (Wratten 93), 
and a blue filter (Wratten 94) in both beams of the microdensitometer. 
Each scan produced 20 optical density readings for each filter along 
each transect. This is equivalent to 20 three-dimensional feature 
measurement vectors per transect. One transect was established for each 
ground pattern area appearing in a frame . The mean of the 20 readings 
per transect for each filter was determined and used in pattern recog- 
nition procedures. These mean transects are listed in Appendix I. 

A total of 160 mean transects for seven ground pattern categories 
were sampled as follows, 52 for cotton, 46 for dry bare soil, 20 for 
sorghum, 19 for low reflecting water, 9 for disked bare soil, 8 for 
high reflecting water, and 6 for medium reflecting water. All mean 
transects from each ground pattern category were used to establish the 
reference mean of the MDM classification model and the reference opera- 
tion constants for the EBC classification model. Recognition tests for 
both models were conducted using all transects. 

Ground pattern areas on transparencies were selected on the basis 
of uniformity in visual appearance of their images. A grease pencil 
was used to mark the location of the transect on the transparency for 
microdensitometer measurements. This procedure gave ground pattern 
areas with homogeneous optical density characteristics. Other criteria 
used for selection of ground pattern areas were derived from ground 
truth considerations for each category as follows: 

a. Cotton selected was in the boll stage with 90 to 100% vegetation 
cover. 

b. Sorghum selected was near harvest stage with 90 to 100% vege- 
tation cover. 

c. Bare soil (dry) represented a variety of dry soil surface con- 
ditions with 0 - 15% vegetation cover. 

d. Bare soil (disked) selected was wet or freshly tilled soil with 
0 - 15% vegetation cover. 

e. Water selected was visually categorized into three levels of 
reflectance (low, medium, and high) depending on sun glinting 
(sun angle). 


ERROR ELLIPSE THEORY 


The mathematics associated with error ellipses evolves from the 
elliptical law of error 2 . This law provides a method for describing 
the distribution of accidental errors for experimental measurements 
involving many variables (features or dimensions) with elliptical curves. 
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In two dimensions (x, y) the law of error is expressed by the 
general equations : 

4> = R exp -(ax 2 +2bxy+cy 2 ) (1) 

where 

ax 2 + 2bxy + cy 2 - H = 0. (2) 

Equation (1) is a probability function that expresses a two-dimensional 
distribution. Equation (2) are curves of like probability that are 
assumed not to diverge to infinity. There are an infinite number of 
values for H, and thus an infinite number of probability curves exist. 


Since equation (2) must be an ellipse, then 

b 2 - ac < 0 (3) 

By rotation of the x, y plane about the origin, the equation of th 
ellipses may be written as 

a' x' 2 + c' y' 2 - H = 0 , (4) 

where the equations of translation are 

tan 20 = -2b/(c-a) , (5) 

c' = h(a+c) ± b esc 26 , (6) 

a' = ^(a+c) + b esc 26 . (7) 

The major and minor axes of the ellipse, 2a and 26, respectively, i 
be determined as follows: 

x ,2 /a 2 + y ' 2 /B 2 = 1 , (8) 


where 


a 2 = H/a* and B 2 = H/c' . (9) 

The probability of a measurement falling outside an ellipse with 

H = H is 
o 

| exp (-H) dH = exp (-H q ) , (10) 

where the integration limits are “ and H . If it is desired that 5 
percent of the experimental points should fall outside the error 
ellipse, then 
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exp (-H ) = 0.05 , 

o 


H = 2.99573227 
o 


( 11 ) 

( 12 ) 


To determine the coefficients, a, b, and c, of equation (2) the 
following equations are used: 


a = 


Ze i 2 (n-1) 


2[£6 i 2 £e i 2 - (£6 i e i ) 2 ] 


(13) 


b = 


-£6.^ (n-1) 


2[£6 i 2 £e i 2 - (£6 i e i ) 2 ] 


(14) 


where 


c = 


£6. 2 (n-1) 

i 


2[£6 . 2 £e . 2 - (£ 5 .e.) 2 ] 

ii ii 


(15) 


£6 2 = £(x-x) 2 = £x 2 - (£x) 2 /n 


(16) 


£e 2 = £(y-y ) 2 = £y z - ayV/n 


(17) 


£6e = £(x-x) (y-y) = £xy - £x£y/n 


(18) 


The mathematics needed for the n-dimensional error ellipse is given 
below: 


6 . 6 . 

P.. = £ -2J- 

^ n..-l- 

iD 


(19) 


a.j = l/2[P ij T ] _1 


( 20 ) 
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6^6 j = (x/‘-x i )(Xj-x^ ) 


( 21 ) 


where 



for a symmetrical matrix. The (T) notation indicates the transpose 
matrix operation. 

The (a^j) matrix contains the coefficients for the general error 
ellipse for any dimension. The elements for the (a^) matrix which 
correspond to the coefficients in the two dimensional general equation 
(2) are: 


a ll = a 


a 12 * b 


(23) 


a 22 = 0 


Expanding the (a^ . ) matrix equation (20) and combining with the 
feature measurement vector X produces the following general equation: 


a ll X l + 2a l2 X l X 2 + 


+ 2a, x!x' 
In 1 n 


+ a 22 X 2 X 2 + 


+ 2a 2n x 2 x n 


(24) 


+ ••• + a x'x' 
nn n n 


- H = 0 


The primes on the x terms above mean that the feature measurement 
vector elements x^, X2 , Xjj must be translated before they can be 
used by equation (24) as follows: 
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XJ = X, - X, 


XI = X, 


( 25 ) 


- X 

n n n 


EBC CLASSIFICATION MODEL FOR n-DIMENSIONS 


For m ground cover pattern classes co^, u> 2 , •••, 0 J m , m error hyper- 
ellipses in n-dimensional space can be generated using equations (19) 
through (25). 

The classification rule for identification of a measurement vector 
X for m ground cover pattern classes may be formed as follows: 

Classify candidate measurement vector X as belonging to pattern 
class 


(ground cover category) w. if: 


n n n n 

£ J a ijL X iL X jL < J J “ijk"ik"jk 

1=1 j=l J J i=l ]=1 J J 


a. x!. x'.. 


(26) 


for all k t L where the index k varies from 1 to m and excludes L. 


A rejection class (threshold) for "everything else" may be con- 
structed for the n-dimensional error hyper-ellipse. A candidate 
measurement vector X is classified as from class if it meets the 
criterion in (26) and fulfills the following condition 


n n 

l l 

k=l j=l 


a. . T x ! _ x ! < H 

ljL lL }L — 


MDM CLASSIFICATION MODEL 


(27) 


Using the EBC optical density measurement vectors m mean and standard 
deviation vectors (X^ and S^) can be developed for m ground pattern 
classes (categories) (wj., u) 2 , w^,). If red (R), green (G), and 

blue (B), light density readings are used as characteristic features 
Xi X 2 ik> and X 3 jj<, respectively, constituting a sample from the 
ith ground pattern class and kth observation, then X^ and Si are defined 
as: 
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X. 

l 


1 

N. 

l 


N. 

r 

k=l 



1 

N. 

y 1 

X 


X . 

N. 

L 

lik 

— 

li 

l 

k=l 


• 

• • 



• • • 

1 

N. 

V 1 

Y 


^3i 

N. 

l 

3ik 


l 

k=l 






( 28 ) 


S. 

l 


N. 

r 


k=l 






(29) 


where k - 1, N. number of observations for the ith ground cover 

pattern class. " 

The MDM classification rule for identification of a candidate 
measurement vector X for m ground cover pattern classes may be formed 
as follows : 3 

Classify measurement vector X as belonging to pattern class 
(category) <o if 

Li 


n n 

l CX(j) - X (j)] 2 < l [X( j ) - X. (j)] 2 (30) 

j=l j=l 

for all i J- L where is m-1 mean measurement vectors calculated for 

X from m-1 pattern classes, excluding pattern class to , and X is the 

Lj l> 

Lth mean measurement vector calculated for X from pattern class to . The 

L 

index j = 1, •••, n represents the number of elements (using optical 
density measurements to red, green, and blue light) formed X, X , and 

_ 1j 

X^ by each pattern recognition model. 
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A rejection class for "everything else" may be developed by em- 
ploying standard deviations as threshold values . Mathematically a 
candidate measurement vector is classified as from class if it 
meets the criterion from equation (30) and fulfills the following 
condition 

l [x(j ) - X L (j)] 2 < T l , (31) 

j=l 

where T t is the threshold for class w T and is given by 
L 

t l = l S L (j) 2 . (32) 

j=l 


EXPERIMENTAL RESULTS AND DISCUSSION 


Scattering diagrams were developed to approximate two dimensional 
measurement space for all ground pattern categories used in this 
report. Scatter plots using the 160 mean transects of red versus 
green (Figure 2 and Figure 3), red versus blue (Figure 4), and blue 
versus green (Figure 5) light optical density measurements were 
constructed. For all four figures each of the 160 mean transect 
points are identified with a letter as cotton (C), dry bare soil (B), 
sorghum (S), low reflecting water (W), medium reflecting water (M), 
high reflecting water (H), and disked bare soil (D). In Figure 2 
the partitioning of measurement space with cells for the MDM model 
is indicated with dashed lines that form irregular polygons . Par- 
titioning with cells for the EBC model is indicated with solid lines 
that form ellipses in Figure 3. A circle with the appropriate letter 
identifies the mean for each circle . Table 1 contains the elliptical 
coefficients and means for all ground pattern categories used to con- 
struct Figures 2 and 3. 

From Figure 5 it can be seen that the blue versus green scatter 
plot does not yield very good separation among ground pattern cate- 
gories. The scatter plot in Figure 4 indicates better separation 
of ground pattern categories than Figure 5 but there is some con- 
fusion between the cotton and sorghum categories. The scatter plots 
in Figure 2 and Figure 3 show good separation among all ground pattern 
categories. For this reason the red versus green combination was 
used for tests comparing MDM and EBC classification models. 
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From casual inspection of Figure 2 and Figure 3 it should be 
immediately obvious that the EBC classification model will yield the 
best approximation of each ground pattern category. The clusters 
representing all ground pattern categories, except cotton, cross 
over MDM partitioning polygonal cells (Figure 2). The points that 
cross over represent those candidate measurement vectors that will 
be incorrectly classified by the MDM classification model. The 
elliptical cells can be tailored for close correspondence to each 
ground pattern category cluster with very few points of any cluster 
falling outside an elliptical cell (Figure 3). 

A recognition test, using the mathematics developed for the MDM 
and EBC models , was conducted using the red and green optical density 
measurements in Appendix I. The results of this test is shown in 
Tables 2 and 3. Overall recognition by the EBC model (94.5%) was 
higher than the MDM model (80.6%). 

CONCLUSIONS 


The theory of error ellipses, developed by Coolidge, was applied 
to the pattern recognition problem. The EBC classification model 
evolved from error ellipse theory yields better pattern recognition 
results (94.5%) than the MDM classification model (80.6%). Scatter 
diagrams show graphically (Figures 2 and 3) that the EBC model pro- 
vides a much better description of ground cover category clusters 
than the MDM model does. These results indicate that the EBC model 
is more efficient than the MDM model for the pattern recognition 
problem. 

Scatter diagrams provide a graphical method for determining those 
characteristic features that yield optimum discrimination results. 

For this report the scatter diagrams in Figure 2 through 5 indicated 
that optimum discrimination results could be obtained with the red 
versus green (Figures 2 and 3) optical density measurements. Ground 
P a ^ ern categories seemed to have better separation using red versus 
green density measurements as compared to using either the red versus 
green or the green versus blue density measurements. 
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Table I. Reference ground pattern mean vectors and covariance matrixes for optical density readings 
of red and green filters used for MDM and EBC classification models. 


Ground 

pattern 

category 

Mean vector 

elements 


(a..) matrix elements 


*1 

Red Optical 
density 

*2 

Green Optical 
density 

a il 

S 12 6 a 21 

a 22 

Cotton 

0.2740 

1.4907 

276.21 

-108.20 

59.11 

Bare Soil 
(Disked) 

1.3171 

1.4400 

272.19 

-394.00 

582.10 

Water (L.R. ) 

1.1678 

0.8373 

105.53 

-116.90 

137.70 

Water (H.R. ) 

0.3851 

0.3084 

8374.50 

-15730.00 

29628.00 

Bare Soil (Dry) 

0.4366 

0.5512 

205.45 

-182.90 

219.05 

Water (M.R. ) 

1.1375 

1.0758 

994.55 

-1337.00 

1919.70 

Sorghum 

0.5351 

1.2910 

93.45 

-70.34 

61.45 


L. R. - Low Reflectance 

M. R. - Medium Reflectance 
H. R. - High Reflectance 
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Table II. Comparison of recognition results for the MDM classification models using the indicated 
ground pattern categories with red and green light EIR optical density measurements as 
characteristic features. A threshold class (T) for "every fling else" was used. 


Ground 

Number 

of 

observation 


Ground 

Pattern 

classified 

as 

Percent 

pattern 

category 

C 

B 

S 

W 

D H 

M 

T 

Cotton [C] 

52 

52 






100.0 

Bare Soil [B] 

46 


35 

1 


7 

3 

76.3 

Sorghum [S ] 

20 


1 

17 


2 


85.0 

Water (L.R.) [W] 

19 


4 


9 

4 

2 

47.3 

Bare Soil 
(Disked) [D] 

9 





5 

4 

55.6 

Water (H.R. ) [H] 

8 


2 



6 


75.0 

Water (M.R.) [M] 

6 






6 

100.0 


Overall percent recognition 80.6% 


L. 

R. 

- Low Reflectance 

H. 

R. 

- High Reflectance 

M. 

R. 

Medium Reflectance 
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Table III. Comparison of recognition results for the EBC classification model using the indicated 
ground pattern categories with red and green light EIR optical density measurement as 
characteristic feature. A threshold class (T) for "everything else" was used. 


Ground 

pattern 

category 

Number 

of 

observation 


Ground 

Pattern 

classified as 


Percent 

recognition 

C 

B S 

W 

D H M 

T 

Cotton [C] 

52 

51 




1 

98.1 

Bare Soil [B] 

46 


41 


2 

3 

89.2 

Sorghum [S] 

20 


19 



1 

95.0 

Water (L.R.) [W] 

19 



19 



100.0 

Bare Soil 








(Disked) [D] 

9 




8 

1 

89.0 

Water (H.R.) [H] 

8 



1 

7 


87.5 

Water (M.R.) [M] 

6 




6 


100.0 


Overall percent recognition 94.5 

L. R. - Low Reflectance 
H. R. - High Reflectance 

M. R. - Medium Reflectance 
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W - Water ( low reflecting) 

H - Water (nedluB reflecting) 
H - Water (high reflecting) 

C - Cotton 

D - Bare Soil (disked) 

B » Bare Soil (dry) 


Positive reproduction, of a 7 One positive infrared 
transparency (Ditachroae MM3), showing hare soil, 
cotton, and water condltiona in the vicinity of the 
Bio Grande Biver. 


fig. 1 
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Opticol Density to Green Light 


Figure 2.- Scatter diagram of red versus green optical 
density measurements for 160 mean transect readings. 
Decision regions for the MDM classification model appear 
as dashed lines. Appropriate letters indicate identity 
of points as cotton (C), bare soil (B), sorghum (S), 
low reflecting water (W), medium reflecting water (M), 
high reflecting water (H), and disked bare soil (D). 

The seven ground cover means appear as a circle with 
the appropriate letter. 


1.84 








0 



Figure 5.- Scatter diagram of blue versus green light 
optical density measurements. Letter identification 
of points is the same as Fig. 2. 
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APPENDIX I 


Computer printout of 160 mean transect optical density measurements 
for Red, Green, Blue, and White Light. 

A Optical density measurements to red light 
B Optical density measurements to green light 
C Optical density measurements to blue light 
D Optical density measurements to white light 

E The average of red, green, and blue light optical density measurements 

F Identification number for each ground pattern category as follows: 

3 - Cotton 

2 - Bare soil (dry) 

19 - Sorghum 

23 - Water (low reflecting) 

4 - Bare soil (disked) 

8 - Water (high reflecting) 

13 - Water (medium reflecting) 
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A 

3 

C 

D 


B 

F 

0.236 

1.377 

1.848 

1.136 


1.154 

3 

0.235 

1.398 

1.886 

1.157 


1.173 

3 

0.235 

1.381 

1.869 

1.159 


1.161 

3 

0.236 

1.405 

1.974 

1.174 


1.205 

3 

0.252 

1.480 

2.044 

1.212 


1.259 

3 

0.261 

1.620 

2.399 

1.294 


.427 

3 

0.211 

1.362 

1.964 

1.150 


.179 

3 

0.208 

1.341 

1.848 

1.133 


.132 

3 

0.230 

1.535 

2.159 

1.246 


,308 

3 

0.209 

1.425 

2.010 

1.173 


.215 

3 

0.214 

1.435 

2.134 

1.186 


.261 

3 

0.212 

1.420 

2.082 

1.174 


.238 

3 

0.223 

1.428 

2.066 

1.181 


.239 

3 

0.245 

1.537 

2.256 

1.250 


.346 

3 

0.235 

1.506 

2.295 

1.210 


.345 

3 

0.258 

1.508 

2.226 

1.224 


.331 

3 

0.277 

1.400 

2.229 

1.185 


.302 

3 

0.228 

1.400 

2.182 

1.162 


.270 

3 

0.259 

1.596 

2.400 

1.270 


•418 

3 

0.407 

1.651 

2.367 

1.364 


.475 

3 

0.397 

1.695 

2.474 

1.383 


.522 

3 

0.366 

1.561 

2.205 

1.299 


.378 

3 

0.201 

1.199 

1.719 

1.023 


.040 

3 

0.198 

1.167 

1.673 

1.003 


.013 

3 

0.211 

1.380 

1.914 

1.121 


.168 

3 

0.206 

1.280 

1.816 

1.075 


.101 

3 

0.195 

1.205 

1.903 

1.029 


.101 

3 

0.265 

1.551 

2.198 

1.241 


.338 

3 

0.375 

1.708 

2.136 

1.376 


.406 

3 

0.474 

1.958 

2.657 

1.544 


.697 

3 

0.433 

1.882 

2.598 

1.499 


.638 

3 

0.424 

1.837 

2.581 

1,470 


.614 

3 

0.442 

1.855 

2.595 

1.490 


.631 

3 

0.376 

1.730 

2.375 

1.381 


.494 

3 

0.382 

1.716 

2.337 

1.384 


.478 

3 

0.373 

1,722 

2.311 

1.381 


.469 

3 

0.296 

1.439 

1.929 

1.216 


.222 

3 

0.233 

1.477 

2.067 

1.216 


.259 

3 

0.225 

1.469 

2.129 

1.206 


.275 

3 

0.282 

1.453 

2.119 

1.217 


.284 

3 

0.259 

1.541 

, 2.210 

1.252 


.336 

3 

0.272 

1 . 434 ’ 

2.060 

1.205 


.255 

3 

0,'282 

1.612 

2.210 

1.317 


.368 

3 

0.230 

1.339 

1.743 

1.140 


.104 

3 

0.357 

1.435 

2.044 

1.247 


.279 

3 

0.355 

1.416 

2.058 

1.250 


.276 

3 

0.346 

1.431 

2.009 

1.246 


.262 

3 

0.175 

1.374 

1.896 

1.121 


.149 

3 

0.186 

1.365 

1.946 

1.130 


1.166 

3 

0.186 

1.374 

1.972 

1.127 


1.177 

3 

0.190 

1.400 

1.950 

1.148 


1.180 

3 

0.187 

1.308 

1.861 

1.072 


1.119 

3 
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A 

B 

C 

D 

E 

F 

0.557 

0.653 

1.046 

0.706 

0.752 

2 

0.558 

0.662 

1.179 

0.727 

0.799 

2 

0.409 

0.520 

0.781 

0.564 

0.570 

2 

0.628 

0.769 

1.394 

0.834 

0.930 

2 

0.521 

0.679 

1.334 

0.758 

0.845 

2 

0.556 

0.716 

1.277 
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